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(57) Abstract: An expert system, in particular for medical diagnosis, includes a memory 2 for storing a plurality of hyixitheses. The 
hypotheses are arranged in a first and second disjoint group of hypotheses. The memory stores questions for rejecting hypotheses of 
the second group. An output 3 is used for supplying questions to a user. An input 4 is used for receiving initial data and answers to 
questions. A processor 5 is programmed to select questions from the stored questions for those hypotheses from the second croup 
that are possible in dependence on the initial data. The processor also determines from answers) received in response to outpuUing 
the selected questions whether at least one of the hypotheses of the second group is possible. In response to determining that no 
hypothesis of the second group is po.ssible, the processor suppHes a most likely hypothesis of the llrsi group. 
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Field of the invention 

The invention relates to an expert system, in particular for medical diagnosi 



Background of the invention 

Huge libraries have been compiled with questions for symptoms relating to 
diseases. Know expert systems for medical diagnosis can use fliese libraries to phrase questions 
and based on Ihe questions calculate the Ukelihood of the diseases. To come to a reUable 
diagnosis the number of questions to be put is too high for practical use. Using only a limited 
number of questions in the known system makes the chance of overlooking a possible serious 
disease too high. This can cause liabiUty issues. Therefore, the known systems evaluate all 
possible diseases fully, making the systems impractical and user unfriendly. 

It is an object of the invention to provide a usct friendly ratpert system, in 
particular a medical diagnosis system, that with a Uniited number of interactions with a user can 
confinn a hypothesis (e.g. make a diagnosis) without risking overlooking hypotheses that may 
not be taken by the system or can not be taken with the Umited number of interactions.. 

Summary of the invention 

To meet the object of the invaition, an automatic expert system includes: a 
memory for storing a plurality of hypotheses, where the hypotheses are arranged in at least a first 
and second disjoint group of hypotheses; and for storing questions for rejecting hypotheses of the 
second group; an output for supplying questions from the memory; an input for receiving initial 
data and answers to outputted questions; a processor programmed to select questions from the 
stored questions for those hypotheses from die second group fliat are possible in dependence on 
the initial data; determme from answer(s) received in response to outputting the selected 
questions whether at least one of the hypoflieses of the second group is possible; and in response 
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to determining that no hypothesis of the second group is possible, supply via the output a most 
likely hypothesis of the first group in dependence on at least the initial data. 

According to the invention hypotheses are divided into two disjoint groups. The 
system tests the hypotheses of the second group with tlie aim of rejecting those hypotheses. 
5 Having successfully rejected all those hypotheses, the system provides as an outcome a most 
likely one of the hypotheses of the first group. In general, it is easier to reject a hypothesis than 
to confirm a hypothesis, implying that fewer questions need to be asked. For example, the 
hypothesis "this person is healthy" can be rejected if a question like "Coughing blood?" is 
answered affirmatively, without knowing exactly what the exact cause of this symptom is. The 

10 same holds for a complex of symptoms. Fewer questions can be used, since it is not required that 
the system issues a positive diagnosis for hypotheses it only needs to rule out. The system has to 
check whether symptoms that are suspicious for at least one of the selected hypotheses of the 
second group are present. If this is the case, the system can not rule a hypothesis of the second 
group out and, generally, the user will be referred to a human expert. After rejecting all 

1 5 hypotheses of the second group, the system issues the most likely diagnosis of the first group 
based on at least the initial data supplied by the user. In many practical implementations the 
second group of hypotheses can be significantly smaller than the first group. Additionally, the 
initial data aids in narrowing down the hypotheses to be rejected. Since all selected hypotheses 
of the second group need to be thoroughly checked, the number of thorough tests can be 

20 relatively small. As an example, in a system that can issue 30 different questions and allows for 
each question two different answers in total 2^° (=1E9) different answer sequences are possible. 
In a conventional system each of these sequences is coupled to an end conclusion (a label, or 
confirmation of a certain hypothesis). In the system according to the invention, only a subset of 
hypotheses must be checked. If they are all rejected, in principle the most likely hypothesis can 

25 be confirmed. In the exemplary system typically only 1E4 answer sequences lead to rejection of 
the most likely hypothesis. If the same number of questions were still used for rejecting these 
hypotheses, the number of fully coded answer sequences would be reduced by a factor of 1E5. In 
reality, the number of questions can also be significantly smaller, leading to an even further 
reduction in possible answer sequences. This saves a significant amount of memory and 

30 increases speed during the evaluation of the given answers. 

It should be noted that also electronic medical encyclopedia are known that enable 
the user to specify a complaint and provide further details regarding the complaint The 
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electronic encyclopedia uses this data to select electronic articles of interest to the user. Such 
systems are not designed 1o confirm or reject hypo&eses. The number of complaints and 
additional data Ihe user can specify for a complaint is preprogrammed. The number of questions 
is limited and targeted towards most common ailments. As such these systems are unsuitable for 
reliably confirming or rejecting hypotheses. In particular, for medical diagnosis such an 
approach has an miacceptably high chance of overlooking a harmfiil pathology. 

to a preferred embodiment as described in the dependent claim 2. the expert 
system is used for medical diagnosis; the initial data including a health complaint; and the 
processor being programmed to select the questions in dependence on the health complaint The 
concept of an expert system wherein based on an initial hypothesis the questions are targeted 
towards testing a selection of alternatives (not all possible hypothesis) can also be used for other 
applications then medical diagnosis. By only having to eliminate a small subset of hypotheses 
the system is simpler, fester, and safer for use as a ftont-end for a human expert that only deals 

with the more complicated cases. 

As described in the dependent claim 3, the first group of hypotheses includes 
hypotheses that may be taken by the system and the second group includes hypotheses that may 
not be taken by the system. For medical diagnosis, the second group typically contains all 
diagnoses that are potentially hatmfiil and require the attention of a medical expert. The first 
group contains (he remaining diagnoses that the system may take. Typically, this includes the 
diseases that do not require any attention or can be cured/treated by Ae user without any fiulher 
assistance of a medical expert The new expert system according to invention eliminates 
symptoms/ complexes of symptoms that are suspicious for harmful ailments instead of fiilly 
evaluating all possible diagnoses fix>m the first and second group and determining a most likely 
diagnosis. As an example, an evaluation involving 11092 patients with an initial complaint of 
coughing (supplied as initial data by the user) showed the top 20 diagnoses that in fact cover 
almost all likely diagnoses. Of fliose 20 diagnoses, seven fall into Ihe first group according to the 
invention and have to be eliminated (those ailments include: asthma, pneumonia, chronic 
bronchitis, emphysema, whooping cough and heart failure). Preferably, at least those seven 
hypotheses need to be rejected (and thus possibly evaluated in more detail) before in principle a 
diagnosis can be given safely. Some more diagnoses that are not in the top 20 may be added to 
the list of hypotheses to be rejected if such a diagnosis, although very rare, is considered urgent 
(e.g. very high fever). As indicated above, in principle a hypothesis can be rejected if none of the 
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symptoms are present that must be checked by a human expert The hypothesis does not need to 
be confiimed. To rule out the hypothesis "asthma" a few symptoms, such as breathlessness 
during the evening/night, breathing with peeping, etc. need to be checked. If any of such 
symptoms is present the hypothesis can not be rejected (and advice of a medical expert may be 
5 required). 

As described in the dependent claim 4, the processor is programmed to determine 
whether at least one of the hypotheses of the second group is possible by comparing received 
answers to a predetermined answer sequence stored in or derivable from the memory. 
Comparing a sequence of received answers with stored predetermined answer sequence(s) is an 

1 0 effective way of determining whether a hypothesis is possible. 

As described in the dependent claim 5, the memory stores for each hypothesis of 
the second group a respective associated question set for rejecting the hypothesis and the 
processor is programmed to select all hypotheses from the second group that are possible in 
dependence on the initial data and to perfomi the selection of questions by combining question 

15 sets of selected hypotheses of the second group. In this way, automatically a list of questions is 
compiled from predetermined sets of questions, where each set of question is optimized for 
rejected a respective hypothesis. 

As described in the dependent claim 6, the processor is progranoaned to supply via 
the output an indication that no hypothesis can be made in response to determining that at least 

20 one hypothesis of the second group is possible. If at least one of the hypotheses of the second 
group can not be rejected by the system (e.g. this would be too risky or would require too many 
detailed questions), the system informs the user that it can not take a positive hypothesis. 

As described in the dependent claim 7, the processor is progranamed to terminate 
outputting questions in response to determining that at least one hypothesis of the second group 

25 is possible. The elimination of the selected hypotheses of the second group stops as soon as the 
system comes to the conclusion that it can not rule out that this hypothesis is possible. The 
system can then not take a decision and there is no need for asking further details from the user. 

As described in the dependent claim 8, the memory stores for at least one 
hypothesis of the first group a respective associated question set for confirming the hypothesis; 

30 and the processor is programmed to, in.response to determining that no hypothesis of the second 
group is possible, and the most likely hypothesis of the first group is associated with a question 
set: output questions of the associated question set; determine whether the most likely 
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hypothesis meete a predetermined criterion in dependence on at least one forther answer; and 
provide an outcome of the determination. After having eliminated the hypotheses of the second 
group, the system is able to forther test a most likely hypothesis of the first group. This improves 
the quality. In general there is no need to thoroughly test all other hypotheses of ihe first group 
since tiie hypotheses of the first group can be taken safely. 

As described in the dependent claim 9, the manory stores for at least one 
hypothesis of the second group a respective associated further question set for confirming the 
hypothesis; and the processor is programmed to. in response to determining that the hypothesis 
of the second group is possible: output questions of the associated question set; detetmme 
whether the hypothesis of the second group meets a predetermined criterion in dependence on at 
least one fiirther answer; and provide an outcome of the determination. If after a first test, the 
system comes to the conclusion that a hypothesis of the second group is possible, the system is 
able to further test the hypothesis, particularly with the aim of collecting more data for 
confirmmg the hypothesis and supply to a medical expert. 

In a preferred embodiment, the system can share questions between hypotheses. If 
an answer to a question has already been received (during testing of an earlier hypothesis), the 
question can be skipped during the testing of a subsequent hypofliesis, redudng &e number of 
interactions with the user. As an example, initial data speci^ng a complaint of a mmiing nose 
may give an ordinary nose cold (rhinitis) as a most likely hypofliesis fifom the first group and 
tries to eliminate hay fever (allergic rhinitis) as an hypothesis of the second group. While 
eliminating the latter hypothesis, die questions to answers testing this hypothesis may show tiiat 
sinusitis (a hypofliesis of the first group) is likely and should, preferably, be tested next The 
system switches flien to flie question set for testing tins hypofliesis. Normally, fliis question set 
will also include flie question(s) for evaluating hay fever. Since answers for tfiese questions have 
already been received, fliese questions can be skipped &om tiie set. Preferably, the system can 
also share possible answers between questions of different question sets (i.e. different 
hypotiieses). This enables using an already received answer also for evaluating other hypotheses. 
As an example, die specific symptom cou^ in combination wifli flie feet fliat fliis occurs 3 times 
or more a year in a person who is over flie age 40 and who smokes, makes it very likely fliat fliis 
person suffers firom Chronic Obstructive Pulmonary Disease (COPD). 

As described in die dqjendent claim 10, tiie processor is programmed to i^date 
die selection of questions during testing of flie questions in dependence on received 
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answer(s).The system continuously updates the list of questions (i.e. hypotheses to be rejected) 
in dependence on input from the user, such as the initial data and/or answers to questions. The 
outcome of a test of a hypothesis may also result in removing other hypotheses from testing. On 
the other hand, an answer given to a hypothesis may make it necessary to evaluate other 
5 hypotheses as well. Although in principle the list of hypotheses to be rejected should be reliable, 
an answer to a question may overrule data already received by the same, e.g. the user may have 

provided wrong or conflicting answers. 

As described in the dependent claims 1 1 and 12, the system rejects or confirms 
■ hypotheses based on initial data supplied to the system and/or answers to earlier questions. 
10 As described in the dependent claim 1 3 and 14, the system can transfer control to 

a human expert, e.g. when a hypothesis of the second group is possible or confirmed. 

As described in the dependent claim 15, the system can retrieve data firom a 
medical record storing system and use data from this record for its operations and/or store data in 
the medical record- Preferably, this includes at least one of the following: 
15 - using the data to select the hypotheses to be rejected (second group), 

- using the data to select the hypotheses to be confirmed (first group), 

- using the data to retrieve answers to question(s) of the question set being tested, 

- storing the initial data in the medical record, 

- storing received answer in the medical record, 

20 - storing in the medical record hypotheses of the second group that can not be ruled out, or 

- storing in the medical record a most likely hypothesis of the first group. 

To meet an object of the invention, a computer program product is operative to 
cause a processor to perform the steps of: receiving initial data via an input; selecting from a 
memory that stores a plurality of hypotheses, where the hypotheses are arranged in at least a first 

25 and second disjoint group of hypotheses, and that stores questions for rejecting hypotheses of the 
second ^oup, questions for those hypotheses from the second group that are possible in 
dependence on the initial data; determining from answer(s) received in response to putputting the 
selected questions whether at least one of the hypotheses of the second group is possible; and in 
response to determining that no hypothesis of the second group is possible, supplying via the 

30 output a most likely hypothesis of the first group in dependence on at least the initial data. 
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These and other aspects of the invention ^ apparent fto« and wUl be elucidated 
with reference to the embodiments described hereinafter. 
Brief description of the drawings 

In the drawings: 

Fig. 1 shows ablock diagram of the system according to the invention. 

Detailed description of the preferred embodiment 

Tl»e expert system according to the invention will be described focusmg on 

medical diagnosis. It will be appreciated that the described technique can be used for ^y expert 
;tm.inplcularthosewi,harelativelyMghnumberofhypothesestobetestedandwh^^ 

Lin hy^theses must be reject^ before other hypotheses may be taken. As an ex^le^an 
^^rsyLincludinge^pertl^owledgeonach^nic^processmayh..^^^^^^ 

Z m Jt have been rejected since the consequences of overlooking the hypotheses may be too 
ri(e.g.dangerofane.plosion)evenifthechanceofthishypothesisbeingtheca^ 

ow The Lpert system according to the invention can al. be used by gove— 1 msutute ^r 
Ilkingwhetheraperson/companyisentitledtosubsidy.Usingtheinitialdat^^ 
.etermi^e^malargecohectionofpossiblesubsidiesamostlikelyoneth.meetsth^^^ 

data The system then aims to test all negative situations (hypotheses) whxch may make 
::ossibletoobta.thesubsidy.lfnoneof.etestedhypothesesapply.inp^c^e^^^^^^^^^ 

si^ed that a subsidy can be requested. Not all possible subsidies that are possible need to be 
evTuated. Itmay be sufficient that it is confirmed thatthemost likely subsidy seemspossrbl. 
• A simUar system can be used for verifying whether a user can apply for a loan or mortage. In 
tieral the system is suitable for. based on initial data, determining a most likely hypo1hes.s«.t 
r,he^venby^es.t«nandviaquestionseliminateanpossiblealterna.ve„ 

25 may not be given by the system. The most likely hypothesis is then only given all of^ 
altLtive hypotheses have been rejected. The outcome of the system can thus be a confirmed 
hypothesis, such as a medical diagnosis. This may also take the fomi of an advice (e.g. 
lecommended subsidy or product to buy). 

,0 Before going into detail of the invention, first an example is given for a medical 

A „™i„a that a complaint ofa user is a cough, the system may determme that 
diagnosis system. Assummg that a compiam , . . „ 

, ^•„™nsisis ordinaryheadcold(i.e.mostlikelyoneofalldiagnose3matchmg 
the most likely diagnosis is. oiaiuaiy 



20 si 
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the initial data and not needing further medical attention). Instead of trying to test all hypotheses, 
the system retrieves list of alternative diagnoses that do need medical attention (and thus need to 
be eliminated). It compiles a list of questions to test these diagnoses and issues the questions to 
the user. Example: if the ankles are swollen (edema) it is not safe to put the diagnosis of an 
5 ordinary head cold. So, the question is put whether the ankles are swollen (can usually be 

checked by the patient by seeing whether the sock edges have given in imprint on the lower leg). 
If the answer is yes, the initial diagnosis can not be made a safely. The system may exit or try to 
positively confirm a more serious disease (in this example, this combination of cough and 
: swollen ankles is suspicious for a heart failure). 

10 Figm-e 1 shows a block diagram of a system according to the invention. The core 

functionality of the system is typically provided by a computer application (software) executed 
on any suitable computer, such as a standalone computer or a server in a network like the 
Intemet. The system includes a storage 2 for storing a collection of questions. The storage is 
preferably a non-volatile memory, such as a hard disk. More details on the arrangement of the 

15 questions will be provided below. Output 3 enables the system to represent the stored questions 
to a user. The output is also used for giving diagnoses, conclusions to a user and/or human 
expert. If so desired, the system may have several outputs. The output may take any suitable 
form, such as a display for displaying the questions and answers provided by the user. The 
output may also be in a spoken form, e.g. via a telephone or generated via the speakers of a 

20 computer. In this case, the spoken messages may, for example, have been pre-recorded in the 
system or on-line synthesized in any suitable way. The output may also be in other forms, such 
as via paper. The system includes an input 4 for receiving input from a user, including initial 
data (such as a medical complaint) and answers to questions issued by the system. The input may 
take the form of a keyboard for receiving the initial data, such as medical complaint, and/or 

25 personal data including age, gender, sex, and (if desired) name, address, medical insurance 
number, etc. The input may also be in other forms, such as handwriting (e.g. using a Personal 
Digital Assistant as input device), or spoken language (using a speech recognizer for converting 
the speech to a representation usable by the system). In a preferred embodiment, the input 
includes measurement equipment, such as a heart monitor or a blood pressure monitor for 

30 providing input data to the system. The output 3 and input 4 may be directly and fixedly 

connected to the main processing part of the system. Alternatively, the output/input may be 
separate fi-om the main part 20. For, example, a patient may operate the system firom a different 
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location, e.g. through a pe^onal coxnputer or mobile phone. Such a .nxote tenn»al . .n^^cd 
using nun^ber 10. ^ main part 20 and the tenninal 10 n.ay exchange data m any su.^ble form, 
e g via local or wide area conrniunication based on wired or wireless technology. To thxs end. 
any suitable protocol may be used, such as SMS. WAP. GPRS. UMTS. E&emet, etc. 
5 The system also includes a processor 5 that under control of a suitable program, 

controls the additional functions of the system, such as the input and output, and provides the 
core functionality of the expert system. The program is preferably ^red in the same storage 2 . 
used for storing the questions. In a preferred embodiment, the system is used as a fton^end f^a 
human It may fully automatically offer assistance for a subset of questions/problems that 

i 0 can be solved by the human expert. M particular, for those questions/problems that cause no 
irreversible consequences if the system makes a wrong conclusion. As such the system can 
operate as a first line help/diagnosis system. It relieves the human expert from the simpler cases 
For the other case, the system may not offer any assistance, refer the user to an expert, or collect 
relevant data and automatically transfer the user (and the collected data) to the expert for 
15 confirming a hypothesis that the system may not confirm. . , H,f« 

According to the mvention. the processor 5 is programmed to receive mrtial data 
from the user via the input Usually, the user will provide at least part of this initial data directly 
to the system (through the input as described above). 

The initial data, including the complaint, is the starting point for commg to a 
20 diagnosis.Forasystemthatisnotcapableofgivingmanydifferentdiagnoses.itispr^erredthat 

first the complaint is specified and the system confirms that it may be able to issues a diagnosis 
for the complaint before the user is requested to enter other data necessary to evaluate 
hypotheses, to this way it can be avoided that the u^ has to provide umiecessary data. 
Similarly, it is preferred that a user first provides some general input, like age and sex, before a 

,5 complaint can be specified. The general data enables the system to compile a list of complamts 
that may be specified by the user. The complaint Ust is preferably compiled based on gender 
and/or age of the user. For example, a complaint 'lower back pain' may normally only be 
specified by users between 1 6 and 55 years old. For children and teenagers this is not a normal 
complaint; for people over 55 without any fi«ther questions it can be concluded that the user has 

30 toconsultamedicalexpert.sincethismayindicatecancer.Asafin:.herexample.complamts 

relating to menstrual complaints will only be specifiable by females between the ages of 12 and 
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55 (outside this age range the complaint may occur but is by definition abnormal and requires 

attention of a medical expert). 

Preferably, the system provides the user with a means of selecting a complaint 
possible for the user. This may be done using drop-down menus from which the user can select a 
5 complaint In a preferred embodiment the user can provide a medical complaint by 

pointing/selecting a part of a human body using a pointer device, such as a mouse, tracker ball, 
touch pad, or remote control. This enables a user to enter the complaint with a minimum of 
interactions. It is possible, as will be described in more detail below, that at least part of the 
initial data is retrieved from another system, like a medical record system, shown in Fig. 1 using 
10 number 10. In the latter situation, the user will normally have to provide some form of 

identification to the expert system or the medical record system enabling the medical record 
system to verify that the record (or part of it) may be released for processing by the expert 
system. 

If the first check by the system reveals that for the initial data it can issue at least 

15 one diagnosis (i.e. there is a likely diagnosis corresponding to a hypothesis of the first group, i.e. 
relatively minor, treatable aibnents) the user can register in a way usual for computer 
implemented systems, for example using a login procedure enabling the computer to establish 
the identity of the user. If the user has not registered before, the system may ask general personal 
data for creating a patient record, such as a medical insurance nimiber. The system can store this 

20 in an own storage, such as storage 2, but may also transfer it to an outside medical record storage 
system, like record storage system 20, that for example is located at the location of a general 
practitioner of the user. Such a storage system may communicate with the main part 20 of the 
system via any suitable interface diat preferably supports confidential exchange of information.. 
The interface is indicated using number 25. The record storage system 20 may be part of the 

25 database of the human expert and though this system 20 data may be supplied to the expert or 
received from the expert. 

The system is preferably directed by an initial complaint that is provided by the 
user as part of the initial data. Typically, the initial complaint is the medical complaint causing 
most grievances or is most dominant at that moment, such as fever. The system stores in the 

30 storage 2 for each specifiable initial complaint a most likely diagnosis that the system may give. 
For example, for a complaint 'running nose' the most likely 'innocent' diagnosis is a cold. It 
may store more diagnoses that it may give, preferably each with their likelihood. These 
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hypotheses that the system may give form a first group of hypotheses, stored in the storage 2. A 
basic system may only support the ten most occurring initial complaints. Such a system can 
serve most of the time approximately 30% of the population for consultations of the general 
practitioner (GP). With 60 most occurring mitial complaints approximately 60% of the people 
can be served most of the time. By supporting approximately 200 initial complaints most people 
can be served most of the time. Usually, an initial complaint is related to more than one 
hypothesis the system may take (forming a first group of hypotheses). For example, an .mtial 
complaint of a running nose is related to the hypotheses rhinitis, sinusitis, influenza, etc. In some 
cases there is a one-to-one relationship between the complaint and hypothesis/diagnosis. In many 
of these cases, the complaint and diagnosis have the same name. For example, the complamt low 
back pain relates to the hypothesis/diagnosis low back pain. Storage 2 also stores a collection of 
hypotheses that the system may not take. These hypotheses form a second group of hypotheses. 
Preferably, the most likely initial hypothesis of the first group is selected based on all ,mt»al data, 
not just the initial complaint. In particular, the hypothesis may also be determined in dependence 
on the gender and/or age of the user. To this end. the storage 2 may store a table like the one 
given below. As described above, not all complaints are possible for all other initial data. 



Gender 


Age 


Complaint 




Hypothesis 






group 


















ID 


Description 


ID 


Description 


Group 


Likelihood 


Male 


<12 


CI 


Pain or 
stinging on 
urinating 


Ml 




2 


Small 


Male 




C2 




M2 ■ 








Female 


<12 


C3 


Vaginal loss 
of blood 


Fl 




2 


Small 


Female 


>1 


CI 


Pain or 
stinging on 
urinating 


F2 


Cystitis 


1 


High 


Either 


>55 


C4 


Lower back 
complaints 


El 




2 


Small 
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In this example, for each complaint an identifier and a textual description is stored. For each 
hypothesis an identifier (e.g. number, possibly complemented a mark that distinguishes between 
the sex and/or age group), a textual description, and a likelihood is stored (based on the initial 
5 data which in this example is: gender, age group, and complaint). The likelihood may be given 
as a percentage, but it may also take any other suitable form that enables the system to rank the 
hypotheses (e.g. a sequential number, or a choice from options, like small, average, high). Also 
an indication of the group to which the hypothesis belongs (i.e. first group or second group) is 
stored. The first and second group may be stored separately, but may also be stored in one 

1 0 collection as is shown in the table above. Using such a shared storing, the groups may be 

identifiable using a label (as shown using the column 'Group. No'), that may be implemented 
using a one-bit indicator indicating the first or second group. The distinction between the groups 
may also be implicit, for example in the outcome following a confirmation of the hypothesis. 

Instead of evaluating all possible hypotheses (those of the first and second group) 

15 that are possible for the initial data, according to the invention tlie system first determines a list 
of hypotheses of the second group that match the initial data, i.e. possible hypotheses that the 
system may not take. To this end, the processor 5 is programmed to select all hypotheses fix)m 
the second group that are possible in dependence on the initial data. Using a table like the one 
described above, the processor can perform this by finding all rows in the tables with the first 

20 three columns matching the gender, age group and initial complaint specified by the user and 
using the fifth colunrn to select only hypotheses from the second group. Having established the 
list of hypotheses of the second group, the system tries to eliminate each of these hypotheses by 
testing the hypotheses using questions. 

To this end, the storage 2 stores a collection of questions for testing hypotheses. 

25 The questions may be arranged in question sets, each of at least one question, where a question 
set contains the questions for testing an associated hypothesis. According to the invention the 
system makes a distinction between testing hypotheses of the first and second disjoint group of 
hypotheses. For each hypothesis of the second group the system stores a respective associated 
question set for rejecting the hypothesis. In a basic implementation of the system, no additional 

30 questions need to be stored for the hypotheses of the first group. In a preferred embodiment, the 
storage 2 stores for at least one h^'pothesis of the first group a respective associated question set 
for confirming the hypothesis. Typically, the questions in a question set are stored sequentially. 
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Tl^e following Uble shows an exan^le of how ix^fonnation on questions and answers n«y be 
Stored, in this example for hypothesis Ml. 



Questions 



Answers 



Answer 1 



Description 



ID 




Description 



ID 



Description 




Description 



10 



15 



20 



Eachquestionnu^ybe stored using several fields, suohasauniqueidentifier^textual 
representation of the question, and answers that may be specified by a -r. The qu^t.on 
identifier «ay sinxply be a nun.b.. enabling a hun>an expert to re^ew and >den.^*e^^ 
,uestions.Preferably.thequestionsareuniquelyidentifiedoverallsetsofquesU^.^^^^ 

'uestion. the system stores at least two possible answers, like a yes/no answer. «o^^an 
lo answers may be po.ible, lilce the answers to a question involving a color rnay be yeUow, 
g^een and purple. P^ferably, the answer field of each question includes for each specifiable 
Lver a textual representation of the answer (e.g. 'green') and an identifier. The answer 
ltifiersmaybesequentiallynumbered.e.g.theidentifierforyellowisl,for^een.^^ 

purpleis3.0fcourseanysuitableidentifiermaybe«se^The^werident.fiermco^^^^^ 
J the question identifier uniquely identifies each answer. In the example shown m the tab e 
the answer identifier already includes the question identifier. The table shows a maxnnum of 
three different answers. It will be appreciated that more answers may be specifiable also. 

The processor 5 is programmed to test the selected hypotheses. It does this by 
retrieving a question of the question set of a selected hypothesis fi:om the storage, provide tb« 
question to <he user via the output of the system and receive an answer to the question from ^e 
user via the input. The processor may also provide to the user an overview of answers the user 
ly .ive. T.. processor is also programmed to evaluate the possibility of the hypothesis m v..^ 
ofIe°givenanswer(s). If it detects thatahypothesis is not possftle any more, it deselects^^ 

hypothesis (in the sense that it for the time being discontinues testing and considenng ttas 
h^othesis). m a simple implementation, the processor retrieves each question set (for respective 
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selected hypotheses of the second group) sequentially and sequentially issues all questions of the 
set until: 

- an answer indicates that the hypothesis is Hkely and can not be rejected, or 

- an answer indicates that the hypothesis is not possible. 

5 If all hypotheses have been rejected, the most likely hypothesis of the first group may be issued 
to the user. Otherwise, testing can stop as soon as one hypothesis of the second group is likely or 
can not be ruled out by the system. In this case, no diagnosis can be issued. Instead, the system 
may recommend the user to consult a medical expert or automatically transfer the interaction to 
the medical expert (or arrange that an appointment with the medical expert is made). The 

10 question sets may be issued in decreasing likelihood of the associated hypothesis (i.e. starting 
with the most likely one and ending with the least likely one). 

Preferably, individual questions and their answers can be shared between question 
sets. Instead of providing the individual question sets of the selected hypotheses of the second 
group sequentially to the user, it is preferred to compile one coherent list of questions that covers 

15 all question sets of the selected hypotheses. In this way, it is simple to eliminate the same 

questions that occur in multiple sets. Moreover, questions of different sets that relate to the same 
subjects can be grouped together, increasing the logical behavior of the system towards the user. 
As an example, question sets Ql and QIC may share same question 121. It is possible that QIC 
(but not Ql) includes a question 122 that collects more detail on the subject covered by 121. If 

20 both sets Ql and QIO need to be tested, it is preferred that question 121 is followed by 122 and 
that not first question 121 is issued and much later question 122 is issued. Such a logical 
behavior of die system may be generated automatically, for example by attaching attributes to 
tlie questions, like a subject. The system can then sort questions of selected sets based on these 
attributes. It is also possible to enabling links between questions to be established, so that the 

25 system ensures that hnked questions in selected sets are provided in the sequence specified by 
the linking: 

An effective way of ensuring a logical behavior of the system is storing 
predetermined question lists in the storage 2 that have been compiled by a human expert based 
on hypotheses of the second group that are possible for a specific set of initial data. The 
30 following table shows an example of one question list of eight questions, numbered one to 8 in 
the first column. 
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Question list X 



Question ID 




Action/conclusion, 
Diagnosis 



10 



15 



example: 

Question 1-. What is the color of the nasal mucus? 
Possible answers: 1 yellow; 2 green; 3: colorless 
Question 2: Does your throat hurt? 

Possible answers: 1 yes; 2 no ^ , , «„h 4- the 

^ .t for Kl is formed by question 6; tiie set for K2 includes questions 1, 3. and 4, 
T^e question set for Kl . fi^ed y q ^^^^ ^^^^^^ ^ 3^ ^ , 

set for K3 consists of questions 1 , 3 , ana d , m ^«„firmiTia a 

. . , i-T>" Tf If '7 iq confirmed, conclusion W is taKen ^.c^. ui»^ 
appointment with a GP . If is coniirni ^ 

.Litis, c» not be ruled out) and the user is directed to the general practitioner. 
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be rejected, conclusion Z is given. This may be "Diagnosis: tracheitis K4: from your answers it 
is clear that you are very concerned. Although there are no indications that you have a serious 
ailment, it is advisable to consult your GP if your concerns stay". If hypothesis K2 (sinusitis) is 
possible, the system is able to test this further. To this end, it retrieves a further question set Y 
5 for specifically further testing of hypothesis K2 with the aim of eliminating and/or confirming 
K2. If K2 is positively confiraied, the data will normally be provided to a medical expert for 
fiirther attention. If the system comes to the conclusion that none of the hypotheses Kl, K2 or 
K4 are possible it may in principle confirm the most likely hypothesis of the first group that 
matched the initial data. Preferably, also answers to questions issued during the testing of the 

10 hypotheses are used to confirm the most likely hypothesis of the first group. The table illustrates 
an effective way of doing this. The most likely hypothesis of the first group is indicated as K3. 
Question 1, 3 and 5 of the question list also provide valuable feedback for hypothesis K3. 
Certain answers to these questions will increase the confidence in issuing this diagnosis, whereas 
other answers to this question may indicate that this hypothesis is not possible. In the latter case, 

15 the processor is programmed to retrieve another (the then most likely) hypothesis of the first list 
that matches the initial data (and preferably also the answers to the questions). 

Having successively rejected all hypotheses of the second group, and possibly 
based on the answers increased the confidence of a most likely hypothesis, the system may be 
able to further test the most likely hypothesis. To this end, the memory 2 stores for a hypothesis 

20 of the first group a respective associated question set for coirfirming the hypothesis. The 

processor 5 is programmed to, if after the testing no hypothesis of the second group is selected, 
further test the most likely hypothesis by providing the associated question set from the memory 
to the user via the output. It receives further answer{s) from the user via the input, and 
determines whether the most likely hypothesis meets a predetermined criterion. The criterion 

25 may, for example be, that it matches at least one predetermined answer key or that a likelihood, 
in view of the answers, is above a defined level or higher than for other hypotheses. It provides 
an outcome of the analysis to the user or to a human expert (or system used by such an expert). If 
the further answers indicate that the hypothesis must be rejected, the system may test the then 
most likely hypothesis of the first group using questions aimed at confirming the hypothesis. 

30 Since in many cases, a most likely hypothesis will be confirmed, it is possible to sequentially test 
those hypotheses without requiring too many questions in most cases. It is also possible to create 
a combined question list from several question sets for hypotheses of the first group. By first 
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testing hypotheses to be rejected, the question list for that will be smaUer than for testing all 
hypotheses. Moreover, the number of answers keys is much smaller. Optionally in a second test 
round questions can be added that not yet have been issued and are required for confirming 
hypotheses of the second group. For this second round of testing (that may not be needed at all) 
5 the number of keys (as will be described in more detaU belo>y) can again be much smaller smce 
only keys for hypotheses of the first group need to be implemented. According to the mventxon. 
the testing of the hypotheses of the second group does not mclude all questions for confirmmg 
hypotheses of the first group. Alternatively or additionally, the answer sequence of a user is 
during the testing of the hypotheses of the second group not compared to at least one answer 
10 sequence (key) that confimis a hypothesis of the first group. In this way the number of questions 
(and thus key lengths) and/or number of keys to be compared can be reduced. Both measures 
significantly increase the performance of the system and reduce storage space. 

nie table also illustrates an effective way of confirmmg or rejecting a hypothesis, 
based on using so-called keys. According to the invention, the system only needs to store keys 
15 that are coded for rejecting the hypotheses of the first list (in this example: those that mdicate 

that hypotheses Kl , K2 or K4 are possible). Column 2. indicated as AO. shows the answers given 
by a user. The keys may be designed only for a specific question set that belong to a hypothesis. 
In the example, each key is designed 1» verify that the corresponding hypothesis can be 
confirmed where the set of questions may also include questions for testing other hypotheses. As 
20 a consequence certain questions are irrelevant for testing a hypothesis. This is indicated by a ' * ' 
in the table. This represents a wildcard in the columns for the hypotheses Kl to K4. indicatmg 
that this item wiU be skipped when comparing the answers AO to the keys Kl to K4; A user may 
also provide no answer to a question, e.g. skip flie question or provide an answer 'don't know' . 
This is represented by a wildcard '*' in the answer column AO (in this example: answer to 
25 question 4). This implies lhat entry 4 of each key will not be compared. It will be appreciated 
that normally answers to questions are not ignored by the system. Smce the intention is to 
•safely' eliminate hypotheses of the second group, it is preferred to interpi^t a 'don't know' type 
of answer as one or more of the other answers that may confirm a hypothesis of the second 
group. For example, if the answer to a question 'Is there blood in your nose?' is 'don't know'. 
30 this will be interpreted as 'yes'. Preferably, storage 2 also stores the keys. The keys may be 
stored in a database, together with the question sets, possible answers to the questions, and 
specific compUations of questions Uste for testing more than one hypothesis using only one list. 
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The storage (e.g. database) preferably also stores for each key the action/conclusion to be made 
if the key matches the answers given by a user (i.e. the hypothesis is possible). The 
actions/conclusions are shown in the last row. 

The table also shows some optimizations of the system according to the invention. 
5 Preferably, individual answers are evaluated immediately after they are given. This can imply 
that the questioning can be stopped if an answer(s) confirms that hypothesis of the second group 
can not be rejected. In the example, if the answer to question 6 is 5, then hypothesis Kl can not 
be rejected. The questioning can stop and the user directed to the general practitioner. It will be 
appreciated that fields in the table that are irrelevant if answers are immediately processed need 

10 not to be fiUed-in. Alternatively, they may be fiUed-in with wildcards. Examples of such fields 
are the fields for question 7 and 8 of Kl and 5 to and including 8 for K2. If so desired, the 
'irrelevant' questions may nevertheless be asked. The answers to these questions can be used to 
alter the weights (i.e. likelihood) of the corresponding conclusion. The answers may also indicate 
that also another hypothesis is possible and even more likely. Preferably, if more than one 

15 hypothesis is likely, the one with the most weight is presented (or presented with most 
emphasis). If two or more hypotheses have a substantially equal likelihood, the one that 
completes first is given most emphasis. 

The table shows for K2 a further strength. Having answered 1 to question 1, 3 to 
question 3 and 2 to question 4, the system comes to the conclusion that it can not yet reject 

20 hypothesis K2. However, the system may be able to do this by using a finther question set Y 

specifically designed for rejecting K2 only. In response to the answer 2 to question 4, it loads the 
question set Y. Together with question set Y it loads one or more keys for testing the answers to 
question set Y and actions if the keys match. Normally at least one of the keys will lead to the 
conclusion that K2 is possible (and most likely that the user must seek medical attention). As 

25 such, the system is able to organize question sets and question lists in a tree structure, where a 
branch of a tree is one question set or list During the evaluation of a set/list an answer to a 
question may result in loading of a further set/list, forming a sub-branch in the tree. Several 
questions in one set may have this effect, all leading to different sub-branches. A sub-branch can 
again have further sub-branches. Starting at the root of the tree, the initial data triggers starting 

30 the evaluation at the most likely branch of the tree. Answers to questions may result in going 

down sub-branches are returning to higher branches. It is even possible to jump firom one branch 
to another branch, that may be hierarchically higher, lower or at a same level parallel to the 
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branch, by linking branches. Preferably, in dependence on an answer the system is operable to 
skip one or more questions of a questions set^ist For example, if a user has indicated that he/she 
has no temperature, subsequent questions on the height and duration of the temperature can be 
skipped. -This can be effected by Imking answers to an individual question to be issued npxt, that 
„«y be a first question of another question set, but may also be a question somewhere m the 

same set (or another set). 

Confirmation of a hypothesis of the first group may result in informing the user of 

the diagnosis and recommending a treatment that can be done by the user without further 
medical attention, whereas a confirmation of a hypothesis of the second group may result m 

urging the user to consult a medical expert. 

The answer keys are preferably entered into the storage of the system using 
templates that enable an operator to indicate that for certain questions multiple answers code for 
rejection of the hypothesis being tested. The keys are then generated automatically usxng the 
template. Hxe following table shows an example of how such a template mayoperate. 



15 



20 



Question ID 



Answer ID 



1 



Exit criterion 



Number of hits 



X 



X 



X 



X 



X 



• Assummg that a que^on set inclJuies the indicated 3 qu W and for each of the questions the 
indicated answers, a human operator can indicate in the third column which of the answers 
contributes to diagnosis/conclusion/action X. In this example, this may result in generatmg four 
keys since two answers of question 1 and two answers of question 3 contribute, givmg the 
following four key sequences: (2. 1. 1), (3, 1. 1). (2. 1. 3). and (3. 1.3). The fourth column shows 
that the user may also mdicate how many 'hits' (i.e. answers given by a user that correspond to 
X) are required before X is issued by the system. During operation, the system initializes for 
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each hypothesis a counter to the value specified by the operator in column four. Each time a hit 
occurs for the hypothesis, its counter is lowered by one, until it reaches zero. At that moment, the 
diagnosis can be taken. In the example, if X has two hits, the hypothesis may be taken. This is 
before any of the four keys has a complete match. According to the invention, the four keys can 
5 then be all combined and the actual matching of answers to the keys in combination with the 
number of hits determines that a hypothesis can be taken. This further reduces the number of 
keys and can also reduce the number of questions that need to be issued. As an example, a 
diagnosis allergic rhinitis' may me taken if seven out of the following eight symptoms are 
present: 

10 • running nose with clear mucus 

• firom both nostrils 

• sneezing 

• facial itch 

• watery eyes 

15 • caused by: pollen or dust or (house) animals 

• more frequent than 3 times a year 

• symptoms present for two weeks or longer 

hi most cases a medical advice given is only valid for a certain period, mostly 
20 seven days. During this period most complaints for which the system can issue a diagnosis 

should have gone. In a preferred embodiment, the system takes the initiative to contact the user 
after such a predetermined period (that may be complaint-specific) and remind the user tliat the 
complaint should have gone. The reminder may take place via email. If the complaint has not 
gone the user may decide to seek assistance from a human medical expert. The reminder may 
25 include such an advice. It is also possible that the user contacts the system again. Preferably, the 
initial data supplied to the system contains sufficient information (like a user name) for the 
system, to determine that the user is a revisiting user. If the complaint is the same, the system 
can based on data stored in its medical records determine the duration of the complaint and 
adjust its advice accordingly. For new users, the system may ask for information on how long the 
30 complaint already exists. If the system detects that a complaint has lasted unusually long, 

preferably the system also automatically informs a human expert. Advantageously, the system is 
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operative to use meta-data as part of testing the hypothesis or as part of selecting the hypotheses 
to be tested. Such meta-data may include the frequency of a complaint. For example, if a user 
contacts a general practitioner more than four times a year with a complaint of a rumring 
nose/cold, the diagnosis is more likely not an ordinary cold, but might be an aUergy. As a further 
example, a recurring cystitis in girls of age 1 to 5 can point to underlying pathology. Persons by 
whom on at least 3 different occasions a diastolic blood pressure of >90 mm Hg is measured do 
most likely have high blood pressure. A single measurement has no predictive value (it can be 
caused by stress or other external factors). SimUarly, a combination of certain drug can cause 
side effects which can account for certain complaints. 



In a preferred embodiment, the system is used to increase flie efficiency of a 
general practitioner (GP). Research shows that more than 70% of patients (hat go to the GP can 
be helped by. for example, a nurse or assistant using well-designed protocols. The system 
according to the invention comes equipped with such protocols in the form of the question sets 
and the automatic selection of hypotheses to be tested in dependence on the initial data. Thew 
system maybe operated mider control of the nurse and as such give a protocoUed judgement of 
the actual situation and the system can indicate which additional information, such as physical 
examinations, must be performed or retrieved, e.g. from the medical records of the patient. This 
information may be retrieved from an own patient database, or via emaiVtelephone be retrieved 
from other medical records, e.g. from a specialist's record or chemist's records, hi this way in 
many cases an adequate diagnosis can be obtained or preparatory work being done without the 
GP having to see the patient in person. This leads to a significant time savmg and may halve the 

average time of a consultation. 

In the case that the system concludes that the complamt is too compHcated (i.e. it 

25 does not support the complaint at all, it has no hypofliesis of the first group that matohes the 
complaint, or it can not reject a hypothesis of the second group), the patient can be referred to 
one of the practice GPs. The data (such as the initial data and question/answers, where necessary 
complemented by data from medical records and automatically obtained measurements) may 
then presented to the GP to enable the GP to quickly grasp the situation and see what most likely 

30 is tiie case and what further questions/answers are required to confirm tiiis. The system 

preferably also indicates hypotheses of the second group to the GP that can not be mled out 
Preferably, the expert system establishes contact with the computer system(s) of the GPs practice 
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or other medical specialist involved in the process to draw the GP's/specialist's attention to that 
fact that such a hypothesis must be checked. The medical expert is presented with a (summary 
o^ the relevant complaint and reasons why the most likely hypothesis of the first group can not 
be confirmed (yet). Preferably, such data can be accessed by the expert with a single activation 
5 of a button or link/menu. Advantageously, the system also provides the expert with a differential 
diagnostical list: a list of possible diagnoses in the order of likelihood. The most likely 
hypothesis of the first group is presented first (e.g. headache) followed by the hypothesis of the 
second group that could not yet be ruled out (e.g. brain tumour). Preferably also a list with 
information lacking to come to the conclusion of an ordinary headache is preferably presented. 

10 In many cases the medical expert can obtain the lacking information via a few directed questions 
to the patient. Mostly, the patient need not visit the expert but the information can be retrieved 
through the phone of via email. Based on the additional information the expert can confirm or 
reject the most likely diagnosis. If an additional medical test or examination is required this can 
usually be performed by a practice nurse. The nurse can enter the result in the records of the 

1 5 system and transfer control back the medical expert. 

In a preferred embodiment, the system is also able to communicate or provide 
data to interested third parties (obviously taking privacy and security regulations into account). 
As an example, the system may generate statistical information for medical insurance companies 
or research institutes. 

20 

It should be noted that the above-mentioned embodiments illustrate rather than 
limit the invention, and that those skilled in the art will be able to design many altemative 
embodiments without departing firom the scope of the appended claims, in the claims, any 
reference signs placed between parentheses shall not be construed as limiting the claim. The 

25 words "comprising'* and "including" do not exclude the presence of other elements or steps than 
those listed in a claim. The invention can be implemented by means of hardware comprising 
several distinct elements, and by means of a suitably programmed computer. Where the 
system/device/apparatus claims enumerate several means, several of these means can be 
embodied by one and the same item of hardware. The computer program product may be 

30 stored/distributed on a suitable medium, such as optical storage, but may also be distributed in 
other forms, such as being distributed via the Internet or wireless telecommunication systems. 
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CLAIMS: 



10 



1 An expert system including: 

a memory for storing a plurality of hypotheses, where the hypotheses are arranged 
in at least a first and second disjoint group of hypotheses; and for storing questions for rejecting 

hypotheses of the second group; 

an output for supplying questions from the memory, 
an input for receiving initial data and answers to outputted questions; 

a processor programmed to: 

select questions ftom the stored questions for those hypotheses from the 

second group that are possible in dependence on the initial data; 

determine from answer{s) received in response to outputting the selected 
questions whether at least one of the hypotheses of the second group is possible; and 

in response to determining that no hypothesis of the second group is 
possible, supply via the output a most likely hypothesis of the first group in dependence on at 
least the initial data. 

2 An expert system as claimed in claim 1, wherein the expert system is used for 

medical diaguosis; the initial data mcluding a health complamt; and the processor being 
programmed to select the questions in dependence on the health complaint. 

20 3 An expert system as claimed in claim lor 2. wherein the first group of hypotheses 

includes hypotheses that may be taken by the system and the second group includes hypotheses 
that may not be takai by the system. 



15 



25 



4 An expert system as claimed in claim 1. 2 or 3, wherein the processor is 

programmed to determine whether at least one of the hypo&eses of the second group is possible 
by comparing received answers to a predetermined answer sequence stored in or derivable from 



the memory. 
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5. An expert system as claimed in any one of the preceding claims, wherein the 
memory stores for each hypothesis of the second group a respective associated question set for 
rejecting the hypothesis; the processor being programmed to select all hypotheses from the 

5 second group that are possible in dependence on the initial data and to perform the selection of 
questions by combining question sets of selected hypotheses of the second group. 

6. An expert system as claimed in any one of the preceding claims, wherein the 
processor is programmed to supply via the output an indication that no hypothesis can be made 

10 in response to determining that at least one hypothesis of the second group is possible. 

7 An expert system as claimed in any one of the preceding claims, wherein the 

processor is programmed to terminate outputting questions in response to determining that at 
least one hypothesis of the second group is possible. 

15 

8. An expert system as claimed in any one of the preceding claims, wherein the 
memory stores for at least one hypothesis of the first group a respective associated question set 
for confirming the hypothesis; and wherein the processor is programmed to, in response to 
determining that no hypothesis of the second group is possible, and the most likely hypothesis of 

20 the first group is associated with a question set: 

output questions of the associated question set; 

determine whether the most likely hypothesis meets a predetermined criterion in 
dependence on at least one further answer; and 

provide an outcome of the determination. 

25 

9. An expert system as claimed in claim 1, wherein the memory stores for at least 
one hypothesis of the second group a respective associated further question set for confirming 
the hypothesis; and wherein the processor is programmed to, in response to determining that die 
hypothesis of the second group is possible: 

30 output questions of the associated question set; 

determine whether the hypothesis of the second group meets a predetermined 
criterion in dependence on at least one further answer; and 
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provide an outcome of the determination. 

10. An expert system as claimed in any one of the precedmg claims, wherein the 
processor is programmed to update the selection of questions during testing of the questions in 

5 dependence on received answer(s). 

11. An expert system as claimed in any one of the preceding claims wherein the 
processor is programmed to perform the determining whether a hypothesis of the second group 
possible also in dependence on answer(s) received for earlier questions and/or the initial data. 

10 

12. An expert system as claimed in any one of the preceding claims wherein the 
processor is programmed to determine a most likely hypothesis of the first group also in 
dependence on received answer(s). 

15 13. An expert system as claimed m any one of the preceding claims, wherein the 

processor is programmed to transfer control to a human expert. 

14. An expert system as claimed in claims 6 and 12, wherein the processor is 

programmed to transfer the control in response to determining that the selected hypothesis meets 
20 Ihe predetermined criterion. 

J 3 An expert system as claimed in any one of the preceding clauns, wherein the 

expert system is used as a medical diagnosis system; the expert system including a 
communication interface for exchanging data regarding a medical record of a patient from a 
25 storage system for storing medical records of patients; the processor being programmed to 

retrieve answers to questions from the medical record and/or store data in the medical record. 

15 A computer program product operative to cause a processor to perform the steps 

of: 

30 receiving initial data via an input; 

selecting from a memory that stores a plurality of hypotheses, where the 
hi'potheses are arranged in at least a first and second disjoint group of hypotheses, and that stores 
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questions for rejecting hypotheses of the second group, questions for those hypotlieses from the 
second group that are possible in dependence on the initial data; 

determining from answer(s) received in response to outputting the selected 
questions whether at least one of the hypotheses of the second group is possible; and 
5 in response to determining that no hypothesis of the second group is possible, 

supplying via the output a most likely hypothesis of the first group in dependence on at least the 
initial data. 
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